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Abstract — The problem of finding the shortest linear shift- 
register capable of generating t finite iength sequences over some 
field F is considered. A similar problem was already addressed by 
Feng and Tzeng. They presented an iterative algorithm for solving 
this multi-sequence shift-register synthesis problem, which can 
be considered as generalization of the well known Berlekamp- 
Massey algorithm. The Feng-Tzeng algorithm works indeed, if 
all t sequences have the same length. This paper focuses on 
multi-sequence shift-register synthesis for generating sequences 
of varying length. It is exposed, that the Feng-Tzeng algorithm 
does not always give the correct solution in this case. A modified 
aigorithm is proposed and formafly proved, which overcomes this 
probiem. 

Index Terms — Shift-Register synthesis, muitiple sequences, 
Berlekamp-Massey Algorithm, Feng-Tzeng Algorithm 

I. Introduction 

In [1], [2], and [3], algorithms for synthesizing a minimum 
length linear shift-register for generating multiple sequences of 
finite length over some field are proposed. These algorithms 

■ can be seen as generalizations of a well known algorithm from 
Berlekamp [4] and Massey [5], which forms the backbone for 

■ efficiently solving a variety of technical problems. 

Linear shift-register synthesis for multiple sequences can be 
applied in the field of coding theory and provides methods 
for efficiently decoding of cyclic codes, interleaved codes, 
concatenated codes and some other code constructions for 
channels with independent errors as well as for channels 

■ with memory. Problems for which shift-register synthesis for 
multiple sequences can be beneficial are described e.g., in [2], 
[6], [7], [8], [9], and [10]. Linear shift-register synthesis for 
multiple sequences of varying length can efficiently be applied 
for example in interleaved schemes with codes of different 
rates, error and erasure correction, in some channels with 
memory and some other applications (see, e.g. [6], [9], [11], 
[12], and [13]). There exist some generalizations and variations 
of the problem. Sequences over rings are considered in [14], 
and [15], periodic sequences of infinite length are analyzed in 
[16]. 

In this paper, we focus on the problem of finding the 
shortest possible shift-register capable of generating multiple 
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sequences of varying length over some field F. The Feng- 
Tzeng algorithm proposed in [1], and [2] solves the shift- 
register synthesis problem for multiple sequences of equal 
length. Moreover, it is stated in [2], that the Feng-Tzeng 
algorithm is also suitable for solving the multi-sequence 
shift-register synthesis problem for varying length sequences. 
However, it turns out, that this is not always true. We illustrate 
by means of a simple counter-example, that the Fundamental 
Iterative Algorithm (FIA) described in [2] fails to give the 
shortest possible shift-register in some cases, when applied to 
multiple sequences of varying length. Consequently, also the 
Feng-Tzeng algorithm derived from the FIA is not applicable 
for sequences of varying length. We explain, why this problem 
occurs and how the FIA needs to be modified in order to work 
correctly for arbitrary varying length sequences. Based on 
this modification, we derive an efficient shift-register synthesis 
algorithm, whose structure is similar to the Berlekamp-Massey 
algorithm and the Feng-Tzeng algorithm respectively. 

This paper is intended to be suitable not only for experts 
in the field of shift-register synthesis, but also for a broad 
spectrum of readers. To give readers which are not familiar 
with [1] and [2] the opportunity to understand conveniently 
the basic ideas behind efficient multi-sequence shift-register 
synthesis, this paper is structured such that we completely 
derive and proof all necessary components of the algorithm 
step by step, closely following the ideas of Feng and Tzeng. 
To aid experienced readers already familiar with [2], we use 
the notation introduced in [2] whenever it is expedient. We 
explicitly point out at which parts of the algorithm we meet 
problems with varying length sequences, and explain, what 
modifications are necessary to guarantee that the shortest 
possible shift-register can always be obtained. 

II. Variants of Shift-Register Synthesis 

Shift-register synthesis problems occur in various applica- 
tions in several variants. Notwithstanding the fact, that we are 
effectively interested in the problem of shift-register synthesis 
for multiple sequences of varying length, we start with briefly 
discussing several variants of shift-register synthesis problems 
to explain an illustrate several aspects which will be important 
in the following. 

A. Single-Sequence Shift-Register Synthesis 

Consider a sequence S = {£i} i= i = Si,...,Sn of N 
symbols over some field F. Now, the task is to find the shortest 
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possible linear feedback shift-register like depicted in Fig. 1, 
such that it generates the complete sequence if it is initialized 
by the subsequence {Si} i=1 . In other words, the problem of 
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Fig. 1. Shift-register synthesis for a single sequence 



synthesizing a minimum length linear feedback shift-register is 
to find the smallest possible positive integer I, and a connection 
polynomial <r(x) = 1 + <j\x + • • • + a\x such that 
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Note, that some of the coefficients rjj may be zero, and 
therefore the degree of a(x) can be smaller than the length of 
the shift-register. In this case, some of the rightmost memory 
elements of the shift-register have no taps, and therefore the 
first elements of Sx, ■ ■ ■ , <SW have no influence on the feedback 
path of the shift-register. Consequently, the length I of a shift- 
register can be very large, even if the degree of a(x) is small. 

Example 1 Consider the sequence 

{Si\Zi =0,0,0,0,1,1,1,1,1,1 

with elements from the binary field ¥2- This sequence can 
be generated by the minimum length shift-register depicted in 
Fig. 2. This shift- register has length I = 5, even though the 
connection polynomial a(x) = 1 + x has degree deg(<x(ir)) = 
1. 
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Fig. 2. Minimum length shift-register for a binary sequence 



Formally we can state the classical single-sequence shift- 
register synthesis problem as follows: 

Problem Let S = {Si\f =1 be a sequence of length N. 
Then, the single-sequence shift-register synthesis problem is 
formulated as follows: Find the smallest integer I, and a 
polynomial a(x) = 1 + <j\x + • • • + uix 1 , deg(cr(a;)) < I, 
such that 

1 

Sj = - 2J cnSj-i, Vj = I + 1, . . . , N . 



At this, the integer I is called the linear complexity of the 
sequence S. 



Problem is the classical shift-register problem considered 
by Berlekamp [4] and Massey [5]. It serves as starting point 
for considering several multi-sequence shift-register problems 
in the following. 

B. Multi-Sequence Shift-Register Synthesis 

Now, we generalize Problem by considering several 
sequences simultaneously. More precisely, we consider t dif- 
ferent sequences — {S^}fL v h = 1, ... ,t of length 
N, with elements from some field F. Now again, we like to 
find the shortest possible linear feedback shift-register, which 
is able to generate all sequences SW, h = l,...,i, from 
the corresponding initial subsequences {s!> }' =1 . Formally 
we state the multi-sequence shift-register synthesis problem 
in the following way: 

Problem 1 Let S = {S^ }£Li, h = 1, . . . , t, be t sequences 
of length N. Then, the multi-sequence shift-register synthesis 
problem is formulated as follows: Find the smallest integer I, 



and a polynomial a(x) = 1 
such that 

1 



0\X- 



-a~ix, deg(a(x)) < I, 



An algorithm for solving Problem 1 is developed by Feng and 
Tzeng in [1], and [2]. A similar algorithm is derived in [3] 
from a lattice base reduction algorithm. Another algorithm for 
the multi-sequence shift-register synthesis problem is conjec- 
tured by Massey and proved in [17]. 

For t = 1, Problem 1 reduces to Problem 0. In this sense, 
the classical single-sequence shift-register synthesis problem 
is a special case of the multi-sequence shift-register problem 
described by Problem 1 . 

C. Varying Length Multi-Sequence Shift-Register Synthesis 

The multi-sequence shift-register synthesis problem can 
further be generalized by allowing the t sequences S^ h > to 
have different length Nh < N, where N = maxjA^^}, and 
h = l,...,t. 

Problem 2 Let = {Sf°}£L\, h = 1 ,...,t, be t 

sequences of length Nh < N, where N = maxjA^/j}. Then, 
the varying length multi-sequence shift-register problem is 
formulated as follows: Find the smallest integer I, and a 
polynomial a(x) = 1 + o\x + ■ • • + crix 1 , dcg(cr(a;)) < / 
such that 



,N h , h = l. 



It is stated in [2], that the Feng-Tzeng algorithm can also 
be applied for sequences of varying length, i.e., for solving 
Problem 2. However, it turns out that this algorithm does 
not generally obtain a correct solution for Problem 2. We 
demonstrate this in Section IV, and explain, how the algorithm 
can be modified and extended such that it is guaranteed to find 
a correct solution for Problem 2. 
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III. Sequences with Wild Cards 

To treat Problem 1 and Problem 2 in a unified way, we 
reduce Problem 2 to Problem 1 by virtually prolonging the se- 
quences which are shorter than N = maxjiV/j} by appending 
N — Nfr special symbols which we call wild cards. Formally 
we describe this prolongation by the following definition: 



Remark: Since the linear complexity of a sequence cannot 
be decreased by prolonging the sequence, any solution of 
Problem 2 is also a solution of Problem 2'. Vice versa, any 
solution of Problem 2' also solves Problem 2. Hence, the 
problems 2 and 2' are equivalent. 



Definition 1 

Let N > N h , and denote by 

S\X = {Si, S2, ■ ■ ■ , SN h ,Xi,X2, ■ ■ ■ Xn-n,,} 



the concatenation of the sequence S = {<S'j} i J' 1 with elements 
Si <E ¥ and the sequence X ~ {Xi} i=1 h whose elements 
are special characters called wild cards. These wild cards 
are placeholders for held elements, i.e., they can be replaced 
by arbitrary elements from F. In this way, S\X describes a 
set of IF^ - ^ different sequences with elements from ¥. 
Each particular choice of the wild cards selects one particular 
sequence from this set. 

In shift-register synthesis problems, the meaning of the wild 
cards is, that each of these placeholders can be replaced 
with a field element chosen by the synthesis algorithm to 
optimize, in some sense, the resulting solution of the synthesis 
problem. Usually, the wild cards are chosen such, that the 
linear complexity of the fully specified sequence is minimized. 
In other words, the wild cards should be specified such, 
that the length of the shift-register capable of generating the 
sequence is as small as possible. In this sense, the wild cards 
are a means of prolonging a sequence without increasing its 
linear complexity. To illustrate this, we consider the following 
example: 

Example 2 Assume, that the wild cards of the binary se- 
quence 

<S = 1,0,1,0,1,0,X 1 ,X 2 

shall be chosen such, that the linear complexity of the fully 
specified sequence is minimized. Here the unique solution is 
X\ = 1 and X2 = 0. 

Using the concept of wild cards, we are now able to restate 
Problem 2 in such a way, that we formally consider all t 
sequences having the same length ./V: 

Problem 2' Let = {Sf l) }f =1 = {S™ 
h = l,...,t, be t sequences of length N = max {Nh}, 
where the last N — Nh symbols of every sequence are wild 
cards. Then, the varying length multi-sequence shift-register 
problem is formulated as follows: Among all possible choices 
of the wild cards, find the smallest integer I, and a polynomial 
u(x) = 1 + <T\X + • • • + (Tix 1 , deg(cr(a;)) < /, such that 
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IV. Minimum Length Shift-register synthesis by a 
Fundamental Iterative Algorithm 

The concept of wild cards can be applied to reformulate 
the multi-sequence shift-register problem as a problem from 
linear algebra. For this purpose, we create the matrix 
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consisting of N stripes. The stripes are created from the t 
sequences S^ h \ h — l,,..,t, by shifting the sequences one 
element to the left in each stripe, and appending a new wild 
card at the end. With the matrix S, our problem is transformed 
to the problem of finding the minimum / and an appropriate 
connection polynomial, such that the first I + 1 columns of S 
are linearly dependent: 

Problem 3 Let = {S^jfL^ h = l,...,t, be t 

sequences of length N = maxj^}, where the last N — Nh 
symbols of every sequence are wild cards, and let S = 
(si, . . . , Sn) be a matrix created from these sequences pur- 
suant to (1). Then, the varying length multi-sequence shift- 
register problem is transformed into the following problem: 
Among all possible choices of the wild cards, find the smallest 
integer I, and the polynomial cr(x) = 1 + a\x + • ■ ■ + aix 1 , 
deg(<j(a;)) < /, such that the first I + 1 columns of S = 
(si, . . . , Sjv) 0.re linearly dependent, i.e., such that 



I + 1, 



,N,h = l, 



Sl+l 



(2) 
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Remark: It can be observed, that Problem 3 is just a refor- 
mulation of Problem 2'. Hence, the problems 2, 2', and 3 are 
equivalent. 

Problem 3 can be considered as a subclass of the very 
general linear algebra problem of finding the smallest initial 
set of linearly dependent columns in a matrix, which is allowed 
to contain wild cards at the end of each row. Formally, this 
problem is stated as follows: 



Problem 4 Let 



lai a 2 



( a i,i 

02,1 



a„) = 



Ol,2 
02,2 



0-2, N 



\OM,l a A/,2 ■■■ O-M.N ) 

be an M x N matrix. The elements Oij of this matrix are 
elements from the field F. However, we allow an arbitrary 
number of successive elements at the end of each row to be 
wild cards. Then, the problem is formulated as follows: Among 
all possible choices of the wild cards, find the minimum I, and 
a polynomial a(x) = 1 + o~\X + ■ ■ ■ + uix 1 , deg(cr(x)) < I, 
such that the first I + 1 columns in A are linearly dependent, 
i.e., such that 



ai+i 



i 

j=i 



(3) 



is satisfied. 



If rank(A) = N for every choice of the wild cards, then all 
columns of A are linearly independent and we formally define 
the solution of the problem to be I = N . The polynomial a(x) 
is meaningless in this case. 

The wild cards in A have the same meaning as the wild 
cards in the sequences, i.e., they are placeholders which can 
be replaced by arbitrary elements from F. However, unlike in 
Problem 3, where the wild cards in the rows of S are related 
to each other, there is no relation between the wild cards in 
the rows of A, so that they can be assigned independently. 
This shall be illustrated by the following example: 



Example 3 Consider the binary matrix 
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with nine wild cards which can be chosen to be arbitrary 
elements from ¥ 2 . Choosing X\ = 1 and Xi = 1 results in 
the first three columns of A to be linearly dependent. Hence, 
a valid solution for Problem 4 is I = 2 and cr(x) = 1 + x + x 2 . 

To describe the relation between Problem 2 and Problem 4, 
we state the following lemma: 

Lemma 1 A solution for Problem 4 with A = S gives a 
solution for Problem 2. 



Lemma 1 immediately follows from the structure of the 
matrix S described by (1), and the equivalence of Problem 2, 
Problem 2', and Problem 3. Hence, we omit a formal proof. 

The fact that we allow wild cards in the matrix A can 
be interpreted as solving the problem with a set of matrices, 
and then taking the matrix with the shortest length solution. 
Particularly in the varying length case, the rightmost elements 
of some rows become wild cards to accommodate shorter 
sequences to the matrix structure. This may result in an 
irregular, i.e., non-triangular arrangement of the wild cards 
in the matrix S. 

In the following, we explain the FIA proposed in [2]. 
Then we demonstrate, that this algorithm may fail to solve 
Problem 4 if we have such an irregular wild card structure. 

From (3) we see, that we can solve Problem 4 by finding 
the minimum I, and a polynomial a(x) such that 

l 

ai,i+i + ^ ^j'Oi.i+i-j =0, V i = 1, . . . , M . 
i=i 

To simplify the notation, we define 

a^'{x) = 1 + di,ix + ai^x 2 + ■ ■ ■ + ai,NX N 

to be a polynomial composed of the elements of the zth row 
of A. Furthermore, we denote by 



a{x)-a^(x) 



3 = 1 



(4) 



the mth coefficient of the polynomial b(x) = a(x)-a^ (x) cor- 
responding to the monomial b m x rn . We call [a(x) ■ a'''(i)] 
the discrepancy for the element a;. m . With this notation, 
Problem 4 becomes finding the minimum / and the polynomial 
a(x) such that 



a{x)-a {l) {x) 



1+1 



= 0, Mi = 1, 



,M 



(5) 



If wild cards are involved in calculating (5) for some i, they 
always can be chosen such that the corresponding equation is 
satisfied. Hence, we obtain \cr(x) ■ a^'(x)\ = 0, whenever 
contains wild cards at some elements for which j < 
m, by implicitly assigning the wild cards to appropriate field 
elements. 

Now we are ready to describe the FIA from [2]. Let D = 
(dij) be an M x N matrix called discrepancy matrix, and 
let S = [cr^ (x), (x), . . . , er w (x)] be some table to store 
temporary er-polynomials crW (x) for all columns i = 1, . . . , N 
of A. Further, let the row index r, and the column index s 
be two integers indexing an element in the matrices A and 

D. With this notation, the FIA is described by Algorithm 1 
in pseudo code. 

After initializing D = 0, S = [0], a(x) = 1, r = 1, and s 
I . the algorithm starts processing A with the leftmost element 
in the first row. For this element, the algorithm calculates the 
discrepancy d = [cr(x) •aP-'(x)\ 1 . If d = 0, processing is 
continued in the next row (i.e., r is incremented by one). If 
d ^ 0, the discrepancy is stored at di.i in the matrix D, and 
the interim er-polynomial <r(x) is saved as (x) in the table 

E. Then processing is continued in the first row of the next 
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column. Here, again the discrepancy is calculated. If d = 0, the 
algorithm moves down one row by incrementing r, and repeats 
calculating the discrepancy, until it meets some element for 
which d 7^ 0. Generally, if d ^ in some row r, and there 
exists a non-zero entry d r>u in D, and consequently also an 
non-empty entry cr' M '(x) in E, the interim er-polynomial a(x) 
is updated to 



a(x) 



<r(x) - —a^(x)x s 

Uir.it 



(6) 



Then, processing is continued in the next row of the same 
column. If there does not exist any non-zero entry in the rth 
row of D, we say that the algorithm gets stuck. In this case, 
d is stored as element d r s in D, and ct(x) is memorized as 
(x) in E. After this, processing is continued in the first 
row of the next column. It should be pointed out, that by this 
procedure, we only obtain one non-zero entry in any row of 
D, and consequently d,, yU in Equation (6) is always unique. 
In this way, the FIA moves through A on a zigzag trajectory 
until it reaches the last row of the matrix. 



D, this discrepancy value is stored in the element ri 2i i of the 
matrix D, and cr(x) is stored in table E, like depicted in the 
graphical scheme below. After this, the FIA jumps to the first 
element of the second column and calculates the discrepancy 
for a\.2- Since d is also zero for this element, processing 
is continued at d2,i- Here we have a non-zero discrepancy. 
However, since there already exists a non-zero element in the 
second row of D, the discrepancy can be turned to zero at this 
position by using c^i stored in D and (x) stored in E to 
calculate a{x) = 1 + x according to (6). After this, processing 
is continued at the element (13 2- Here we again have a non- 
zero discrepancy but no non-zero entry in the corresponding 
row of D. Consequently, d and a(x) are stored in D and 
E respectively, and processing is continued at 013. In the 
graphical scheme, the positions at which a modification of 
a(x) are performed are marked by boxes, positions at which 
the algorithm gets stuck, and d and <r(x) are stored, are 
marked by circles. 



Algorithm 1: Fundamental Iterative Algorithm 
input: M x N matrix A 

D = (dij) <- 0, E <- [0], a(x) <- 1, s <- 1, r <- 1 
while (r < M) and (s < N) do 

d <— [(t(x) ■ (x)] s /* discrepancy for a r , s */ 

if d ^ then 



jl"»(l)l s -" 

/* move down */ 

/* store discrepancy in D */ 
I* store current <j(x) in £ */ 
/* move right */ 
/* move to the top */ 

/* move down */ 



if 3 u : d r 


u ^ then 


a(x) «- 




_ r <— r - 


f 1 


else 
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<7^(x) 


<- a(x) 


s <— s - 


f 1 


r <- 1 





else 

|_ r <— r + 1 

I <- s - 1 
output: I, a(x) 



To illustrate how the FIA works, we consider an example 
for a binary matrix A without wild cards: 

Example 4 Consider the 6x7 matrix 
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The FIA starts processing this matrix at the upper left corner 
with the a-polynomial cr(x) = 1. Since the first element an is 
zero, the discrepancy is also calculated to be zero. Therefore, 
the algorithm moves on to the element c^i for which d = 1. 
Since there is not yet any non-zero entry in the second row of 
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The FIA continues processing A along the depicted trajectory. 
Whenever it meets a non-zero discrepancy, it checks whether 
this discrepancy can be fixed using some previously stored 
element from D and E. If no previously stored data is 
available, it jumps to the first element of the next column, 
until it reaches the element 04 5. Here, a(x) is modified by 
using (£4^4 and cr' 4 ' (x) from D and E respectively. After this 
modification, the discrepancy in the 5th column will be zero 
for all remaining rows. Hence, the FIA reaches the last row 
of A in column s — 5 and terminates with I = s — 1 = 4. 
Consequently, the first I = 4 columns of A are linearly 
independent. Furthermore, since cr(x) = 1 + x 3 + a; 4 after 
termination of the FIA, we know, that the sum of the first, the 
second, and the fifth column will result in the all-zero vector. 

As proved in [2], and demonstrated in the previous example, 
the FIA works for solving Problem 4 for a matrix A without 
any wild cards. Now we consider a matrix A with an irregular 
wild card structure. We have such a structure, for example, if 
we apply the FIA to the matrix S pursuant to (1), created from 
multiple sequences of varying length. It is stated in [2], that 
the FIA can also be applied for this irregular case. However, 
we show in the following by means of a counter-example, 
that in general, the FIA does not solve Problem 4, if A has 
an irregular, i.e., non-triangular wild card structure. 
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Example 5 We again consider the 6x7 matrix A from 
Example 4, but now with some independently assignable wild 
cards at the rightmost positions of the matrix rows: 



A = 



Since the non wild card elements of A coincide with the matrix 
elements from Example 4, there exists a way to select the wild 
cards in such a way, that we obtain the same solution as in 
Example 4 or possibly even another solution with a smaller I. 
Hence, if we apply the FIA to A, we expect to get a solution 
with I < 4. The graphical scheme below shows the application 
of Algorithm 1 to the matrix A with wild cards. Whenever a 
wild card is involved in in calculating d = [cr(x) ■ a^ r '(x)] s , 
the discrepancy is assumed to be zero. This means, that the 
algorithm implicitly assigns values to the wild cards, such that 
it yields a zero discrepancy. 
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It can be seen, that the FIA behaves exactly in the same as 
way, as for the case without any wild cards, until it reaches the 
element 04,5. Since we have the wild card X4 at this position, 
the FIA assumes the discrepancy at this position to be zero. 
This means, that it implicitly assigns X4 = 1 to the wild 



card in order to obtain [a(x) 



(*)]t 



0. Then, the FIA 



goes ahead to the element without changing a(x). Here 
it observes a non-zero discrepancy but no non-zero element in 
the 5th row of D. Consequently, s is incremented to s = 6 
and processing is continued in the next column until 03 ^ is 
reached. At this element, cr(x) is updated to cr(x) = 1 + x + 
x 2 +x 4 + x 5 . Then the FIA reaches the last row of A without 
further modifying a{x), and terminates with I = s — 1 = 5. 
However, we know from Example 4, that the wild cards in A 
can be chosen such, that we are able to obtain I = 4, and 
cr{x) — 1 + x 3 + x 4 . Hence, the solution obtained by the FIA 
is not a valid solution for Problem 4. This shows, that the FIA 
described in [2 ] may fail in finding the smallest initial set of 
linearly dependent columns for matrices with wild cards. 

To understand, why the FIA fails in Example 5, we consider 



its behavior when it meets a wild card at some position. In 
such a case, it forces the discrepancy to be zero by implicitly 
assigning a suitable value to the wild card. If the FIA processes 
a non wild card element after this, it has no possibility to revise 
its assignments of the values of the previously processed wild 
cards. Hence, it continues solving the problem with a smaller 
set of matrices, which might not contain the smallest length 
solution. In this sense, the FIA can be considered as a Greedy 
Algorithm. The matrix A used in Example 4 is just an instance 
of the matrix from Example 5, i.e., we can select the wild cards 
such that we get A from Example 4. However, after processing 
0,4. 5, the wild card is implicitly fixed to 1 such that the matrix 
from Example 4 will not longer be considered as a possible 
solution. 

To fix the problem discovered above, two strategies are 
conceivable. One possibility is to find an algorithm, which 
is able to go back and revise its assignments of the wild 
cards to allow for checking all possible values for each wild 
card position. The other possibility is to completely avoid the 
processing of wild cards unless we meet a wild card element 
a T:S for which all following elements a r +i jS , ...,au,s m the 
column are also wild cards. In this case we know, that the 
algorithm will terminate in the same column. Hence, we do 
not exclude any potential solutions until we find the column at 
which we terminate and consequently obtain a solution with 
minimum I, regardless of the selection of the wild cards. 

Since the first solution seems to be algorithmically quite 
complex, we propose a modification of the FIA, which is 
based on the second idea. It turns out, that this solution is 
quite simple and merely consists of a preprocessing step on 
the matrix A. In the following, we describe this modification 
and then we formally prove, that the modified algorithm will 
always succeed in finding the correct solution. 

Let AbeaMxJV matrix with elements from the field F 
which is allowed to contain an arbitrary number of successive 
wild cards at the rightmost positions of its rows. Now, define 
by sort(A) an operation on the matrix A, such that its rows are 
sorted from top to bottom to have a non-decreasing number 
of wild cards. Since permutations of rows do not influence 
the linear dependency of the columns, solving Problem 4 for 
the matrix A = sort(A) yields exactly the same result as 
solving the problem for the matrix A. Just with this simple 
sorting operation we are able to state a modification of the 
FIA which we call Sorted Fundamental Iterative Algorithm 
(SFIA). This algorithm overcomes the problem demonstrated 
by Example 5. Algorithm 2 gives a description of the SFIA 
in pseudo code. 

Algorithm 2: Sorted Fundamental Iterative Algorithm 
input: M x N matrix A 

A <— sort (A) 

Apply Algorithm 1 (FIA) to A 
output: I, a(x) 



To demonstrate how the SFIA actually behaves in contrast 
to the FIA, we consider the following example: 
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Example 6 Let A be the same 6x7 matrix A already 
considered in Example 5. We obtain the matrix 



A = 



by sorting the rows of A from top to bottom in such a way, 
that we have a non-decreasing number of wild cards. Then, 
Algorithm 2 operates on A like depicted in the graphical 
scheme below: 
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We observe, that unlike Algorithm 1, the SFIA processes the 
first wild card X4 not until it processed all non wild card 
elements in the forth column. In this way it ensures, that the 
polynomial cr(x) does not need to be modified after X4 is 
processed, since all symbols below X^ are also wild cards. 
Hence, whenever the SFIA processes its first wild card and 
therefore implicitly fixes its value, the correct solution is 
already determined, and the algorithm will terminate without 
further modifying a(x) or I. In this way, the greedy nature of 
the FIA can never exclude all valid solutions from the set of 
possible solutions. 

Now, we go ahead with proving, that Algorithm 2 solves 
Problem 4 for any number of wild cards at the last elements 
of each row of A. To provide a self-contained paper and ease 
understanding, we present the complete chain of proof even 
though some parts are equivalent to the proofs presented in 
[2]. For readers already familiar with [2], we explicitly point 
out, at which points these proofs will fail for certain wild card 
configurations, and how our modification works in eliminating 
these problems. 

First we show, that the update rule (6) applied to some 
element in the rth row will result in a a(x), which yields zero 
discrepancy in the rth and all previous rows. 



Lemma 2 Let a r _i, s and a r s be two elements in the sth 
column of A. Denote by <7 r _i(x) the a-polynomial after 
processing a r ~i, s such that [cr r _i(x) • d' r_1 )(:z;)] s = 0. 
Further assume, that we have a non-zero discrepancy d = 
[<j r -i(x) -a^(x)] s , and that there exist a non-zero entry d r>u 



in the rth row and the uth column of the discrepancy matrix 
D, and a corresponding entry 0^ (x) in the table E. Then, 



a r (x) = a r -i(x) — — — (x)x s 



is such that 



[a r (x)-d^(x)] s = 0, Vi = l,...,r 



(7) 



(8) 



is satisfied. This means, that a r (x) yields zero discrepancies 
for the rth and all previous rows in the sth column. 

The proof for this lemma applies techniques, which are quite 
similar to the techniques used in [5] to show the correctness 
of the Berlekamp-Massey algorithm. 

Proof: By inserting (7) into (8) we obtain 



[<r r (x)-&W(x)] 



= [a r ^(x)-a^(x)] s - —[a^{x)a^{x)x s - u ] 



From (4) we deduce, that 

[a r {x) ■ aS l > (x)x p ]j 
and consequently we can write 

[a r (x)-a^(x)] s 

= [<7 r _i(a;) • a^(x) 



[a r (x) ■ a^' (x)]j- p 



— [<j^(x)d^(x)] u 

OjT.11 



- 



-0 = 0. 



d - -r-d r , u = , i 



1 < i < r- 1 
r 



since 



a^(x)d^(x)] u 



1 < i < r- 1 
i = r 



due to Algorithm 2. ■ 
From Lemma 2 we conclude, that if the algorithm termi- 
nates at column s < N, then the first s columns of A are 
linearly dependent. However, to prove that the SFIA solves 
Problem 4, we do not only need to show that we find an 
arbitrary initial set of linearly dependent columns, but the 
smallest one. To be able to do this, we need two further 
lemmas. 

Lemma 3 Let A be a matrix which may contain wild cards 
at the rightmost positions of its rows. Furthermore, let A = 
Sort(-A). Assume, that the SFIA is processing some wild card 
element a r _ s — Xi in the sth column. Then all elements 
a r +i lS , . . . , cim.s ore also wild cards. 

The statement of Lemma 3 follows immediately from the 
triangular wild card structure of the sorted matrix A. 

Lemma 4 Assume that the SFIA is processing some element 
of A in the column s + 1. Then the first s columns of A 
are linearly independent. For the case, when A contains wild 
cards, it means that it is not possible to assign values from the 
field F to them, such that the first s columns of A are linearly 
dependent. 



X 



Proof: The fact that the FIA processes some element 
in the (s + l)th column implies, that we have a discrepancy 
matrix D for which each of the first s columns is non-zero. 
Each of these columns contains exactly one non-zero element 
d r .j in some row rj, such that n ^ ^ • • • 7^ r s . Hence, 
we have a submatrix D s consisting of the first s columns 
of D, which has s rows with only one non-zero element. 
Consequently, we can bring D s to an column Echelon-like 
form D' s by permuting its columns. From this form we see, 
that rank(Z? s ) = rank(£)' s ) = s. To ease understanding of 
this step, we consider the matrix D from Example 4 and 
assume, that we are processing some element in column 5. 
Then we have 



D„ 




D' 




with rank(Z? s ) = 4. 

Furthermore, we have s polynomials a^(x) stored in table 
£ for which we know, that they yield [cr"' (x) ■ aM' (x)]j = 
for all rows i < rj, and [a^'(x) ■ a^'(x)]j ^ for the row 
i = rj. Therefore, we can create a M x s matrix D s = 
{dij) with dij = [a^ (x) ■ a^'(x)]j with the property, that 
for the column j the first rj elements coincide with the first 
Tj elements of the matrix D s . Furthermore we know, that 
no wild cards have been included in the calculation of these 
coinciding elements, since if the algorithm would have met 
any wild card while processing some column j < s, it follows 
from Lemma 3 that it would terminate at this column which 
contradicts the assumption that we are processing column s+1. 
Hence, we also can bring D s to a column Echelon-like form 
D s , and conclude from this, that rank(£) s ) = s regardless of 
the choices of the wild cards in A. To illustrate this, we again 
consider the example from above: 
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Since all elements of D s are calculated by [a™' (x) ■ a^ 1 ' (x)]j, 
it becomes clear by considering (4), that all columns of the 
matrix D s are just linear combinations of the first s columns 
of A. Hence, the submatrix A s composed of these s columns 
has also rank(A s ) = s. Consequently, the first s columns of 
A are linearly independent, for all possible choices of the wild 
cards. ■ 
Note, that if the FIA operates on an unsorted matrix A, all 
elements of D s may depend on wild cards. Consequently, the 
upper right corner of the matrix might only be zero for a 
special choice of these wild cards. Consequently by showing 
that the rank of D s obtained from the unsorted matrix is equal 
to s, we do not prove that the first s columns are linearly 
independent regardless of the choice of the wild cards. And in 
fact, it is not always true as illustrated by Example 5. As 
we can see there, is possible to assign values to the wild 
cards in the fifth row such that the first 5 columns are linearly 
dependent, even though the matrix D s resulting from the FIA 



has rank 5. Hence, Lemma 4 is not proved for an unsorted 
matrix A, and indeed, is does not always hold for this case. 
Now, we are able to prove the following theorem: 

Theorem 1 Let A be some M x N matrix which may contain 
an arbitrary number of wild cards at the last positions of each 
row. Applying Algorithm 2 (SFIA) to a matrix A will always 
solve Problem 4. 

Proof: Algorithm 2 terminates, if it reaches the M th row 
in some column s and [a{x) -a^ MS, (x)] s = is satisfied. From 
Lemma 2 we know, that [u{x) ■ a^ r \x)] s = also holds for 
1 < r < M which means, that the first s columns are linearly 
dependent, and can be linearly combined to the all-zero vector 
using the corresponding coefficients of a{x). Furthermore, it 
follows from Lemma 4, that the first I = s — 1 columns 
of A are linearly independent. Therefore, there cannot exist 
a smaller I, for which the first I + 1 columns of A are 
linearly dependent. If the algorithm does not terminate before 
it reaches the last element in the column s = N, it increments 
s and terminates because of the second condition in the while- 
loop. In this case it obtains I = N, which means, that all 
columns of A are linearly independent. Since sorting the rows 
of a matrix does not influence the linear dependency of its 
columns, the statements from above also hold for the matrix 

A. m 

V. A Modified Iterative Algorithm utilizing the 

STRUCTURE OF THE MATRIX S 

In the previous section we described and proved an algo- 
rithm for solving Problem 4. However, our actual goal is to 
find an algorithm to synthesize a linear feedback shift-register 
for generating multiple sequences, i.e., for solving Problem 2. 
As already mentioned, this problem can be considered as a 
special instance of Problem 4 in which we use a matrix S 
like shown in (1), composed from the t sequences we like 
to generate. If all these sequences have the same length, 
the first t rows do not contain any wild cards. Hence, the 
matrix S is already structured such, that its rows are sorted 
from top to bottom with a non-decreasing number of wild 
cards. Consequently, the FIA will always succeed in finding 
the correct solution for the shift-register synthesis problem. 
However, if our t sequences have different lengths, some of the 
t rows in the first stripe already contain wild cards. This means, 
that S is not longer sorted with respect to a non-decreasing 
number of wild cards in the rows. Hence, for varying length 
sequences, we need to apply the SFIA instead of the FIA to 
generally obtain a valid solution. 

From a theoretical point of view, the multi-sequence shift- 
register synthesis problem for sequences of varying length 
is solved at this point. However, for practical reasons it is 
desirable to have an algorithm, which is as efficient as possible. 
Therefore we would like to utilize the structure of S to 
improve the efficiency of the SFIA. Actually, our goal is to find 
an algorithm, whose algorithmic structure is similar as possible 
to the Berlekamp-Massey Algorithm. However, unlike [2], we 
do not aim directly for this goal but introduce an intermediate 
step, in which we derive a modification of the SFIA, which 
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utilizes the special structure of S. This modification is of 
minor practical relevance, but it enables us to understand, 
derive, and formally prove our final algorithm. 

A. Utilizing the structure of S for equal length sequences 

To understand how we can manage to reduce the complexity 
of the SFIA, we have to analyze the structure of the sorted 
matrix S = sort(S). For this purpose, we first consider the 
case, that all t sequences have the same length N. The matrix 
S consists of N stripes, each containing t rows with the same 
number of wild cards. Hence, we can decompose S into 



S = 



( ~ zW \ 



V Z« / 



whereas for k = 1, . 



N any Z W 



- f 9 W 

'i,3 



is a t x N 



matrix whose rightmost part is a block of t x (k — 1) wild 
cards. We observe, that for k > 1, 1 < i < t, and 1 < j < 



N, the element zf\ in the matrix Z 



,[k] 



element z\ in the previous matrix Z 



is equivalent to the 



In this context 

we want to point out, that "equivalent" does not simply mean 



have the same value in one 



that the elements z\ k j and 

particular matrix 5. It rather means, that in each matrix S, 



the elements z\ h j and are identical. To emphasize this, 

we write zj-j = z^- +1 J . 

Now, assume that Algorithm 2 operates on the sth column 

\k] 

of the sorted matrix S and gets stuck at some element z h s , 
k > 1, because the discrepancy obtained at this position is non- 
zero, and there is no non-zero element in the corresponding 
row t ■ (k — 1) + i of the matrix D. From the structure 
of Algorithm 2, and from Lemma 2 we know, that for the 
current polynomial a(x) at this position all discrepancies for 
the previous elements are zero. Consequently, Algorithm 2 
continues processing at the first element of the column s + 1 
and calculates zero discrepancies, until it reaches the element 



*[*-!] 



^jfs+i m the matrix Z l " " J . If there is no non-zero element in 
the corresponding row t ■ max{0, k — 2} + i of the discrepancy 
matrix D, it encounters the same problem as before for the 
element z^\. Hence, if k > 2 it jumps again to the first 

- [k— 2] 

element of the next column and gets stuck in Z unless it 
finds some non-zero element in the corresponding row of D. 

From these observations we conclude, that if Algorithm 2 
meets a scenario as described above, it just moves up and 
right on a staircase from stripe to stripe without modifying 
<t(x) until it finds a non-zero entry in D, or reaches the 
first stripe of S. However, the SFIA performs this movement 
on a zigzag trajectory jumping from column to column and 
calculating discrepancies for many elements for which it is 
already clear, that they are zero. Consequently, the SFIA can 
easily be optimized such that it straightly moves up along the 
staircase instead of jumping up along its zigzag trajectory. 

Generally we can say, that the SFIA performs two types 
of movements while processing the matrix S. If it moves 
down along a column, it modifies the cr-polynomial whenever 
it encounters a non-zero discrepancy, and non-zero entries are 



„[*-!] 



available in D and E. We call such a movement downward 
movement. If a non-zero discrepancy is encountered, and no 
non-zero entries are available in D and E, the algorithm 
cannot continue its downward movement and gets stuck. If 
this happens, the algorithm moves up along a staircase of 
identical matrix elements. We call such a movement staircase 
movement, regardless of whether it is performed on a zigzag 
trajectory or straight along a staircase. During a staircase 
movement, the cr-polynomial is not modified. However a 
staircase movement implicitly causes a prolongation of the 
shift-register, as soon as the algorithm meets a non-zero entry 
in D and switches over again to its next downward movement. 
If the algorithm reaches the top of a staircase without finding 
an appropriate non-zero entry in D, it continues its downward 
movement in the next column at the first row of the matrix. 

To illustrate the observations discussed above, we consider 
Fig. 3. Here we have a matrix S consisting of two sequences 
of length 8. In this matrix, an exemplary trajectory is sketched, 
which demonstrates the different types of movements de- 
scribed above. The matrix elements at which the SFIA gets 
stuck are surrounded by circles, some elements forming a 
staircase are shaded grey. Downward movements are depicted 
by solid lines. A staircase movement along a zigzag trajectory 
(like performed by the SFIA) is depicted by a dotted line 
whereas a straight movement along the staircase is drawn as 
dashed line. 
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Fig. 3. Movements of the Sorted Fundamental Iterative Algorithm 



B. 77ze varying length case 

Now consider the case in which we are actually interested 
in, i.e., the case of sequences of varying length. Here we have 
t sequences S^ h \ < N, h = 1, . . . , t from which at least 
one has length N. Then, as before, the sorted matrix S consists 
of N stripes, each containing the same number of wild cards. 
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Hence, we are again able to decompose S into 



S = 




(9) 



and there is no non-zero element in the corresponding row 
Si=i ^ « + ^ of £), we can move upwards along the staircase 
until we find a non-zero element in D, or reach the topmost 
step of a staircase. In the latter case we proceed like before 
and go ahead with the first element of the following column. 

C. Further improvements due to the staircase structure 

The staircase structure of the matrix S can further be uti- 
lized to simplify the SFIA. For this purpose, we focus our con- 
siderations again on the staircase movement. Assume that the 
SFIA gets stuck at some row during a downward movement 
with a non-zero discrepancy value corresponding to the 
sequence S^ h \ Then, during the following staircase movement 
it will inscribe rfw into the matrix D along an ascending 
diagonal until it meets a non-zero entry in D, or reaches the 
end of the staircase. Hence, if the SFIA gets stuck the first 
time in some row r processing an element of the sequence 
h, it will inscribe non-zero entries into all rows of D located 
above the row r, which correspond to the sequence S^ h \ If 
the SFIA gets stuck the next time for the same sequence 
at row r' , the following staircase movement will fill all empty 
rows between row index r and r' corresponding to sequence 
S^ h \ Consequently, the stripe index at which the SFIA may 
get stuck during a downward movement when processing an 
element of the sequence will increase with any further 
downward movement. We formalize this observation by the 
following lemma: 

Lemma 5 Assume that the SFIA operates on a matrix S and 
performs a downward movement in column s, and that it got 
stuck at some element z h in stripe k during the previous 
We see, that the two uppermost steps in the staircase of S^ J downward movement in column s'. Then, the SFIA can get 
are smaller than the lower steps. Furthermore we observe, that stuc k in z [ ^\ if and only if the discrepancy value d calculated 



However, unlike in the equal length case, the stripes on the top 

of S may now consist of a smaller number of rows, i.e., the 

- [fc] 

matrices Z are ti. x N matrices with i& < t. Nevertheless, 

~ [k] 

we still have a staircase relation between the matrices Z , 
but with a possibly decreasing step size at the top of S. This 
does not change anything at the principle explained above, 
even though it makes the notation more complicated. To keep 
the notation as simple as possible, we assume w.l.o.g. that 
the t sequences are sorted with respect to their lengths, i.e., 
N = Ni > N2 > • • • > N t . Furthermore, we assume that 
whenever sort(-) is applied to S, the matrix is sorted in a 

way, that all rows within a submatrix Z^ are ordered such, 
that a line corresponding to the sequence S^ h ' occurs above 
a line corresponding to S^ 9 > whenever h < g. In this case, an 
element zfj in the matrix Z^ is equivalent to the element 



z\ k j+l m the previous matrix Z^ l \ 



i.e. 



-[*] - 
z- — 



whenever k > N - Ni + 1, i < t k , and 1 < j < N. The 
structure of S is illustrated in Fig. 4 for the case of two 
sequences, one having length 7, and the other having length 5. 
Like in Fig. 3, S consists of seven stripes. However, unlike in 
the equal length case, the first two stripes only consist of one 
row. Consequently, we have a staircase structure with stairs of 
different heights, and some of the staircases do not reach up 
to the top of the matrix. To illustrate this, the staircases for the 
elements (solid line) and (dashed line) are sketched. 



the staircase for S^' does not reach the first stripe in S but 

- [31 

ends at Z . 
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at Zu \ is not zero, and the stripe index is k > k' . 

Proof: Assume that the SFIA gets stuck in its first 
downward movement at the element zff 1 ^ in the stripe k\. If 
hi > 1, the following staircase movement will inscribe non- 

li] 

zero elements to D corresponding to the elements z h k 

- [»] 

into all stripes Z with k\ > i > 1, in which the sequence 
S^ h ' is included. Hence, during the next downward movement 
the algorithm cannot get stuck at some element z^ 2 ~ as long 
as ki < k\, since it always will find a corresponding non- 
zero entry in D to update the A-polynomial. However, the 
SFIA will immediately get stuck at a non-zero discrepancy 
for z^f if &2 > ki, because there are no non-zero rows 
in D corresponding to SW beyond the stripe fe. If the 
algorithm gets stuck at zt % ~, ^2 > k\, the following staircase 
movement will inscribe non-zero entries to the elements of D 



at all positions corresponding to z^ 



&2 > i > ki. 



Fig. 4. Staircase structure of S for sequences of varying length 

The fact that we now have stairs of different heights does 
not prevent us from using the same ideas as before, for the 

case of equal length sequences. If we are processing some 

>] 



element corresponding to for k > N — Nf, + 1, SFIA gets stuck at some element zl then after performing 



Consequently, there are no all-zero rows corresponding to 
the sequence S' h ' in the matrix D above the stripe ki, and 
no non-zero rows beyond this stripe. This induces that the 
SFIA gets stuck during the following downward movements 
at the fist stripe beyond at which a non-zero discrepancy 
is encountered. From this we conclude, that whenever the 
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a staircase movement there will be no all-zero row for the 
sequence <Sw in D above the stripe k' and no non-zero 
row beyond this stripe. Consequently, the algorithm gets stuck 
during the next downward movement at element zri if and 
only if k > k', and a non-zero discrepancy is calculated at 
this point. ■ 
Lemma 5 provides us with a simple and powerful criterion 
to decide, whether the next processing step has to be a 
downward or a staircase movement. We do not anymore need 
to rely on the matrix D to take this decision. Hence, there 
should be a way to completely dispose the matrix D in our 
modified algorithm. 

D. An alternative update rule for cr(x) 

To further improve the SFIA, we consider the table S, 
where we store a temporary cr-polynomial for each column 
we process. A polynomial (x) is stored whenever the 
algorithm processes column u and reaches some row r = 
S»=i + ^ corresponding to the sequence for which 
it cannot obtain a zero-discrepancy using 

d r , u and a^{x). 

Hence, the table £ may contain several entries corresponding 
to one and the same sequence. In particular, all entries in 
S corresponding to the non-zero entries in D, which lie on 
the same staircase, are temporary er-polynomials for the same 
sequence. If we manage to get by with just one temporary cr- 
polynomial for each sequence, we are able to further optimize 
our algorithm. To show that this is actually possible, we define 
the polynomial 



(x) = 1 + §isx + St^x 2 + ■ • ■ + §i t NX 



N 



composed of the elements of the row i of S. Then, we consider 
the following lemma: 

Lemma 6 Assume that Algorithm 2 is processing the element 
s r _ s and obtains d = [<J r -i ■ s^ r \x)] s ^ using the cr- 
polynomial a r -i(x). Further assume, that there exist a row 
index r' > r, a column index s' < s and an integer m such 
that 

dr'.s' ^ , 

< m < s — s' , 



— ^r,s'-\-7n j 



and that the elements s r>s , s r ' iS /, and s r , S '+m correspond to 
the same sequence S^ h \ Then, the polynomial 



a r (x) = oy_i(x) - a {s,) (x)x s - s '- m (11) 

d r i 



satisfies 



[a r (x)-s^(x)] s =0, Vi = l,...,r. 



(12) 



This means, that a r (x) can be used as new interim cr- 
polynomial cr{x) in Algorithm 2. 

Proof: To prove Lemma 6, we insert (11) into the left 
hand side of (12). In this way, we obtain 

d 



[<T r -l(x)-8®(x)] 



[a {s ' ) {x)-s {l \x)-x s - s '- m } 



(13) 



From (4) we deduce, that 

[a< s '>-s^(x)-xP] s = [a^-s^(x)] s ^ 
Hence, we can rewrite (13) and obtain 



[<7 r _i(a;)-*W(a;)] s 



[a^\x)-s^(x)} s/+m . (14) 



s (i) 



Since we assume, that Algorithm 2 is processing the element 
s rs , we know, that 



[a r -i(x)-§W(x)} 




(15) 



Furthermore, since we assume, that Algorithm 2 already 
processed the element s r i s i with s' < s and r' > r, we 
have 



[a< s '\x)-s^{x)] i 




(16) 



From (10) we know, that s r /. s / = s r tS >+ m - Hence, since 
Algorithm 2 performs a staircase movement from s r > jS to 
Sr.s'+m, (16) is transformed into 

[a^(x).sU(x)} S ' + r n =i° 1 1 ~ i<r ■ (17) 

la r ' jS / i = r 

Consequently, by inserting (17), and (15) into (14), the left 
hand side of (12) becomes 

[<7 P _i(s) •*«(*)]. - ^-[<r (s ' } (xys ii+r '- r) (x)}s' 

d r 




This proves Lemma 6. ■ 
Now we consider the fact, that S can be decomposed 
into stripes according to (9). To accommodate to this stripe 
structure, we reformulate Lemma 6. For this purpose, we 
assume, that s r s = and s r i s * = zjfi. Then, s rs > +m = 
z h s , +m and m = k — k. Together with the polynomial 

4 feI w = i+4^+4V + ---+4V JV 



(10) this gives rise to the following corollary: 



Corollary 7 Assume, that Algorithm 2 is processing an ele- 
ment and obtains d = [cr(x) ■ z\^(x)] s ^ using the 
interim cr-polynomial a(x). Further assume, that there exist a 
stripe index k' > k, a column index s' < s, and a row index 
r' = J^iLi 1 + ^< su ch that 

d r >,s' + , 

s' + k' < s + k , 
[fc'] = s 

Z h,s' — s r',s' ■ 



Then, the updating rule 
cr{x) <— o~(x) - 



d r ' 



-a^'\x)x s - s ' +k - k ' 



(18) 



gives a valid new interim a -polynomial. 



12 



Corollary 7 enables us, to modify the SFIA in such a way, 
that we can keep only one temporary a -polynomial a^ h \x) 
for every sequence 5W, h = l,...,t, instead of storing the 
complete table S with N entries. To do this, we proceed as 
follows: if we get stuck at the element fj* J, having d ^ with 
the interim er-polynomial a(x), we proceed like the SFIA and 
assign a(x) to the temporary cr-polynomial a^ h '(x). Together 
with crC 1 ) (x) we memorize s', fc' and d in the auxiliary buffers 
s (h)^ ^(/i)^ an( j j snoW; jhat these values are sufficient 
for further updating, we consider the case, when we next time 
have d ^ for some element z h ' . From Lemma 5 we know, 
that the SFIA is able to update a(x) only, if fc < k'. Otherwise 
we get stuck at this point. Hence, if the SFIA is able to update 
a(x), we always have k' > k. Furthermore we know, that 
s — s' > k' — k, since otherwise we would be situated above 

\k'] 

the staircase originating from z h ,, which would imply d = 0. 
Thus, the conditions of Corollary 7 are satisfied whenever the 
SFIA is able to update a(x), which in turn means, that we 
can use the update rule (18) equivalently to the update rule 
(6) during the downward movements. Consequently, Lemma 5 
together with Corollary 7 enables us to completely abandon 
the matrix D. 

E. The Modified Iterative Algorithm (MIA) 

Now we propose a Modified Iterative Algorithm (MIA), 
which utilizes the improvements provided by the staircase 
structure of s, based on the Lemmas 5 and 6. This modified 
algorithm requires the following auxiliary buffers. For each 
sequence S^ h \ h = 1, . . . ,t, we use a buffer s^ h > to memorize 
the column and a buffer k^ h ' to to store the stripe index at 
which the discrepancy d^ 1 ' has been calculated. Then, the MIA 
is described in pseudo code by Algorithm 3. 

Even though the MIA is an improvement compared to the 
SFIA with respect to various aspects, it still is based on a 
matrix S, and is by far not as elegant as the Berlekamp- 
Massey algorithm. And indeed, we do not propose the MIA to 
be used as an improvement of the SFIA. It rather serves us as a 
theoretical basis to derive and prove an efficient algorithm with 
a structure similar to the Berlekamp-Massey algorithm in the 
next section. Clearly, to be suited for this purpose, we formally 
need to prove the correctness of Algorithm 3. Therefore, we 
consider the following theorem: 

Theorem 2 Let S {h \ h = 1, . . . , t, be t sequences such 
that N = Ni > N 2 > ■ ■ ■ > N t , and let S be a 
M x N matrix created from these sequences according to 
(1). Applying Algorithm 3 (MIA) to the matrix S will always 
solve Problem 3, and hence also Problem 2. 

Proof: Algorithm 3 differs in three aspects from Algo- 
rithm 2. The first difference is, that is does not always jump to 
the top of the column s + 1 and continuing processing there, 
if it gets stuck. Instead, in cases where it hits a staircase, 
it moves up and right along this staircase, having the same 
non-zero discrepancy in any step, until it reaches the top of 
the staircase or a step in which the discrepancy can be fixed. 
Since all discrepancies above the stairs are known to be zero, 



Algorithm 3: Modified Iterative Algorithm 



this movement will result in the same outcome as the zigzag 
movement of the original SFIA. 

The second difference is, that whenever it encounters a non- 
zero discrepancy d = [a(x) ■ z^f 1 (x)] s , it compares the current 
stripe index k with the stripe index k^ previously stored for 
the sequence h and performs a staircase movement whenever 
k > k^ h \ It follows from Lemma 5 that this is equivalent to 
checking the corresponding rows of D for non-zero elements. 

The third and most momentous difference to Algorithm 2 is, 
that we sometimes use different polynomials to update a(x). 
From Lemma 6 we know, that these alternative polynomials 
can always be used to update a(x) such that [a(x)-s'^ (x)] s = 



input: M X N matrix S 

cr(x) *— 1, s «— 1 
S «- sort(S) 

fc(fc) «_o, aW(x) <-0,h = l,...,t 

for each k from 1 to N do 

Llk] 

create Z /* decompose S into stripes */ 

determine ifc /* determine number of rows in the stripe */ 

k <- 1, h <- 1 



/* discrepancy for zi k \ */ 



while (k < N) and (s < N) do 

d^[a{x)-zf(x)] s 
if d ^ then 

if fc < k^ then /* move down */ 

a(x) <- a(x) - -faaW( x ) x °-> (h, +*-* (h) 
h-*-h + l 

if h > tk then /* move on to the next stripe */ 

h <- 1 

_ k <- k + 1 

else /* move up along staircase */ 

fc <— fc, s <— s, a(x) <— a(x) 
if fcW > then 

a{x) ^ < j{x)-J KJ ^ h \x)x s - s{h)+k - k{h) 

s<— s + k- fc (/l) 
fc <- k^ 

else /* staircase ends, jump to the first row */ 

s<-s + k-N + N h 
k<-l,h<-l 



else 



d (h) <- d 
<- s 
fcW <- fc 
, ffW(s) <-5(a?) 

ftf- h + 1 
if h > tk then 

h <- 1 
fc <- fc + 1 



/* store discrepancy ... */ 
/* ... column, ... */ 
/* ... stripe, ... */ 

/* ... and cr(x) */ 

/* move down */ 
/* move on to the next stripe */ 



output: I, a(x) 
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in the row r and all previous rows. Hence, if MIA reaches 
row M in column s and [cr(x) -s'( M ) (x)] s = is satisfied after 
updating a(x) (if necessary), we know that the first s — 1 
columns are linearly independent. Furthermore we observe, 
that Lemma 4 is applicable to Algorithm 3 without any 
modification (we only have to replace A by S). Consequently 
we know, that there does not exist a smaller I = s — 1, for 
which the first I + 1 columns of S are linearly dependent. ■ 
Note, that the MIA and the SFIA sometimes use differ- 
ent temporary polynomials to update a(x). Thus, the two 
algorithms are not equivalent. And in fact, we do not prove 
that Algorithm 3 is identical to Algorithm 2 when applied 
to a matrix S. We just show, that it always obtains a valid 
solution for our problem. So, if this solution is not unique, 
it is conceivable that the SFIA and the MIA could obtain 
different results. However, this fact is completely irrelevant for 
our goal since we are only interested in finding a minimum 
length solution, we do not to require to obtain a certain one. 

VI. An Efficient Algorithm for varying length 
multiple Shift-Register Synthesis 

The SFIA described in Section III is actually merely an 
algorithm for finding the smallest set of linearly independent 
columns in a matrix with wild card elements at the right- 
most positions of its rows. As shown, it can be used for 
solving the minimum length shift-register synthesis problem 
by creating a special structured matrix from the sequences. 
The improvements of the MIA are achieved by exploiting this 
special structure. Nevertheless, the MIA is still an algorithm 
operating on a matrix created from our sequences. However 
it would be much more natural and also more efficient to 
find an algorithm which directly operates on the sequences, 
rather than intricately creating the matrix S before the actual 
algorithm can be applied. In other words, our goal is to find 
an algorithm which directly solves Problem 2 without the 
detour of solving Problem 4 instead. Therefore we propose 
an efficient shift-register synthesis algorithm whose structure 
is quite similar to the Generalized Iterative Algorithm for 
Multiple Sequences (GIAMS) described in [2]. However, our 
algorithm is guaranteed to work also for the case of varying 
length sequences. 

To reach our goal, we consider the MIA and take care 
that our new algorithm exactly mimics the behavior of the 
MIA, i.e., all intermediate cr-polynomials are identical to 
those created by the MIA. Even more, it is possible to 
identify a one to one correspondence between the auxiliary 
variables of the MIA and the new algorithm. In this way, the 
MIA serves not only as theoretical basis to derive our new 
algorithm but it enables us also to formally and consistently 
prove its correctness by showing the equivalence between the 
processing steps of the MIA and the new algorithm. Regardless 
of this equivalence, the pseudo code description for our new 
algorithm given by Algorithm 4 appears even optically much 
simpler in comparison to Algorithm 3. In fact, the order 
of complexity of Algorithm 4 is just t times the order of 
complexity of the Berlekamp-Massey algorithm, which means 
that calculating the joint linear complexity for t sequences 



can be performed with the same complexity as calculating the 
linear complexity for each of this sequences independently. 

Algorithm 4: Efficient Shift-Register Synthesis Algorithm 
input: SCO = {fif }^, h = 1, . . . , t, N = m&x{N h } 

begin 

I <- 0, o-(x) <- 1 

n {h) ^ N - N h , lW <- 0, for h = 1, . . . , t 
dW <_ l, o-O) (x) <- 0, for h = 1, . . . , t 
for each n from 1 to N do 
for each h from 1 to t do 

if n — I > N — Nh then /* align to the right */ 

" J n-N+N h ' l^j=l u 3°n-j-N+N h 

ifd^O then 

if n - I < - l (h) then 

else 

I <— I, <j(x) <— <t(x) 

I <_ n _ ( n W _ j(/0) 
1(h) ^ I a (h)^ <_ ^ 

_ «- d, «- n 

end 

output: I, a(x) 



The following theorem formally states the correctness of 
Algorithm 4: 

Theorem 3 Let SW, h = 1, . . . , t be t sequences, such that 
N = N\ > N 2 > ■ ■ ■ > N t . Applying Algorithm 4 to this 
sequences will always solve Problem 2. 

Proof: Theorem 3 can be proved by showing that 
Algorithm 4 is equivalent to Algorithm 3, i.e., that the final 
result as well as all temporary calculated cr-polynomials are 
identical for both algorithms in any step. Therefore we first 
identify the correspondences between the auxiliary variables 
in both algorithms. First of all, I is the length of the shift- 
register in both algorithms, which coincides with the column 
index s — 1 in Algorithm 3, i.e., 

8 = 1 + 1. (19) 

Furthermore, the variable n in Algorithm 4 corresponds to the 
index of the rightmost element o^_ N+N in the subsequence 
{Si}™Zi' +Nh currently processed. By examining the structure 
of the matrix S we observe, that the shift-register length I and 
the element index n in Algorithm 4 is related to the stripe 
index k in Algorithm 3 by 

k = n-l. (20) 

The same holds for the auxiliary variables l^ h \ and k^ h \ 
h = l,...,t, i.e., 

feW = nW - lW . (21) 
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The polynomial a(x) as well as the auxiliary variables d( h > 
and a^ >{x) coincide in both algorithms. Now consider the 
update rule 

a( X )^a( X )-^H^ s - sW+k - k{h) 
used by Algorithm 3 and the update rule 

used by Algorithm 4. Since we can substitute 

s - «W +k — fc (/l) 



by 



{I + k) - (l^ + k^) =n-n (fc ) 



the update rules in both algorithms are identical. The discrep- 
ancy d is calculated in Algorithm 3 by d <— [cr(x) ■ z[ k \x)] s . 

Considering the relation between the stripes Z^ k \ and the 
matrix S described by (9), we have the following relation: 



3=1 



[fc] 

3 Z h,s-j 



Sk+s-N+N h -l + X V]Sl'^ s _ N+Nh _ 1 _ j 



3=1 



S n -N+N h + ^2 a 3 S n-j- 
3=1 



N+Nh ■ 



The latter form is exactly the equation used by Algorithm 4 
to calculate the discrepancy d. 

Now, after we identified the correspondences between the 
variables in both algorithms, we have to show that they 
perform matchable operations in any processing step. To do 
this, we artificially expand the matrix S as depicted in Fig. 5. 
In each stripe which has less than t rows, we add dummy 
rows (shaded gray), such that each of its stripes has an equal 
number of rows. Furthermore we add a new stripe with the 
index k = on top of the matrix, consisting of t dummy 
lines. Now we assume, that Algorithm 4 performs virtual 
downward and staircase movements on S ext . Therefore, we 
first consider the inner for-loop in the algorithm. Here it 
is first of all checked whether n — I > N — Nh- If this 
condition is not fulfilled, nothing is done inside the loop. 
This means, that only the sequence index h and the element 
index n are updated, but no data processing is performed 
whenever n — I > N — Nh is not fulfilled. In terms of the 
matrix notation this condition checks, whether the current 
stripe index k is larger than the length difference between the 
longest sequence, and the sequence Sw, This is the case for 
all rows of S ext but the dummy rows. Hence, Algorithm 4 
actually performs data processing only on the non-dummy 
rows, i.e., the rows of the matrix S. At these rows, it uses 
identical temporary cr-polynomials and equivalent values in the 
auxiliary buffers as we already showed above. Consequently, 
during the (virtual) downward movements of the Algorithms 3 
and 4, both algorithms perform absolutely equivalent data 



~[i] 



z [4] 
z [6] 



1 




Ml) 

°2 


& 


c(l) 

D 4 


°B 


s' 1 ' 


? 


? 


? 


s< 2) 


o(2) 
a 2 




s< 2 ' 




°2 


°3 


si 1 ' 


s« 




si 1 ' 


? 


? 


s< 2) 


s< 2) 


s< 2) 


s< 2) 


sf 


o(l) 

°2 




qW 






si 1 ' 


x} 1 ' 


? 


sf 


tj(2) 
°2 


s< 2 ' 


s< 2) 


e(2) 


x< 2) 




°4 


o(l) 
°B 


cj(l) 




x' 1 ' 


x« 


s< 2) 




o(2) 
°3 


s< 2) 


o(2) 
°5 


x< 2 > 


x< 2 > 






°e 


s« 


xf> 


x^ 


x« 


0(2) 


c<2) 
°3 


c(2) 


s< 2 > 


x< 2) 


x< 2 > 


x< 2 > 


sp 




si 1 ' 


X« 


x« 


xf 


xf> 


o(2) 
°3 


s< 2) 




x< 2 > 


x< 2 > 


xf 


xf> 


sP 




x« 




x« 


x« 


xl 1 ' 


s< 2 > 


S< 2) 


x< x) 


xi 2) 


xf) 


xf 


xf» 



V 4 2 



x; 



Xi 

x< 



(1) 

5 

(2) 
5 



Fig. 5. Expansion of the matrix S 



processing steps on the same sequence elements modifying 
the cr-polynomials in the same way. 

Now we consider the staircase movements. Algorithm 3 
performs a staircase movement whenever k > k^ h \ According 
to (20), and (21), this is equivalent to the condition n — I > 
n \h) _i(h) m Algorithm 4. First we assume, that the temporary 
polynomial (x) is already initialized, i.e., that a^ h ' (x) ^ 
for some h. This implies, that in Algorithm 3 the auxiliary 
variable fc^ 1 ' is such that k^ > 0. Consequently, a staircase 
movement is performed by assigning s <— s + k - fcW and 
k <— k^ h \ i.e., by ascending the staircase k — few steps. 
Due to (19), (20), and (21), this is equivalent to assigning 
I <— n — — l( h >) in Algorithm 4. As shown above, the 
(7-polynomial is updated by the same rule in both cases. 

Now assume, that we perform a staircase movement for 
some h for which a^ h '(x) = 0, and consequently also fcW = 
in Algorithm 3. On the first glance, the two algorithms behave 
different in this case. Algorithm 3 will not perform any update 
of a{x) but moves to the column s + k — N + Nh and 
performs a downward movement beginning from the first row. 
Algorithm 4 updates the cr-polynomial, but since (x) = 
this update does not effectively change a(x). The staircase 
movement is performed by updating I <— n — N + Nh- 
If we again imagine Algorithm 4 virtually operating on the 
matrix S ext , this is equivalent to moving right to column 
k + s — N + Nh- However, unlike Algorithm 3, the downward 
movement is not performed from the first row, but from row 
h + 1 in stripe k = N — Nh if h < t, and in row 1 of 
stripe N — Nh + 1 if h = t. However, due to the structure 
of S and ■S'ext respectively, all elements above this point 
are such that n — I < N — Nh holds or they yield a zero 
discrepancy. Consequently, during its downward movement, 
Algorithm 3 does not modify <r(x) and the auxiliary variables 
until it reaches the row where Algorithm 4 starts its downward 
movement. On the other hand, Algorithm 4 skips all rows for 
which n — I < N — Nh, i.e., all virtual rows which are not 
included in S. Hence, both algorithms behave equivalent also 
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in this situation. 

From these considerations we conclude, that whenever 
Algorithm 3 and Algorithm 4 change the cr-polynomials a(x) 
and (j( h \x), or the length I, they do it in exactly the same 
way using the elements of the sequences in the same order. In 
this sense, the two algorithms are equivalent. ■ 

To ease understanding of the proof, we illustrate some of 
the applied arguments by means of the following example: 

Example 7 Consider the matrices S and S ext created from 
three sequences of length 7, 6 and 5 like depicted in Fig. 6. 
The matrix S consists of '7 stripes with the indices k = 1, . . . , 7 
and a total of 18 rows. To create S ext , we add a stripe with 
index k = consisting of three dummy rows at the top of this 
matrix and complement the first stripe by adding two dummy 
rows and the second stripe by adding one dummy row. In this 
way, we get a matrix with 8 stripes and a total of 24 rows. 
The additional rows are marked by hatched boxes. 
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Fig. 6. Equivalence between Algorithm 3 and Algorithm 4 

Now we consider a fictitious trajectory of Algorithm 3 
trough the matrix S and compare it to the virtual trajectory 
of Algorithm 4, if we imagine it to operate on the matrix S ext . 
Both algorithms start in the first column at the first row of 
the stripe k = 1 with a downward movement. Assume that 
Algorithm 3 obtains zero discrepancies, until it gets stuck at 
the second row of the fourth stripe ( marked by "1 "). Here 
it assigns (x) <— 1. After Algorithm 4 has processed its 
first element, it immediately hits two rows in a hatched box 
for which n — I < N — iV/, holds. Hence it just skips this 
rows without performing any data processing ( depicted by an 
arc). This means, that Algorithm 4 performs data processing 
on the same elements as Algorithm 3, until it also gets stuck 
at the second row of stripe 4 ( marked by "a ") and assigns 



1. At the points "1" and "a" respectively, both 



algorithms perform a staircase movement. 



Algorithm 3 stops at the end of the staircase in the second 
stripe ( element marked by "2 ") and jumps to the first row of 
the fourth column. Here it starts his next downward movement, 
at which it encounters a zero discrepancy at the first element 
(marked by "3"), since the same element has already been 
processed with a zero discrepancy in the first column of stripe 
4. Therefore, Algorithm 3 gets stuck the next time in the second 
stripe (element marked by "4") and assigns (x) <— 1, 
and d' 1 ' <— d. Algorithm 4 ends its staircase movement 
at stripe k = N — N% = 1 in the hatched box (element 
marked by "b") and skips the rows in the hatched box, until it 
continues its downward movement at stripe 2 ( element marked 
by "c"), where it also gets stuck. It assigns cr^(x) <— 1 and 
<— d here. Since the element marked by "4' in S, and 
the element marked by "c" in S ext coincide, both algorithms 
again get stuck at the same point. Algorithm 3 processes an 
extra element (marked by "3"), but since it is clear that this 
element will yield a zero discrepancy the a-polynomial and 
the auxiliary buffers are identical in both algorithms at the 
points "4" and "c" respectively. 

From the point marked by "4 " Algorithm 3 performs its next 
staircase movement which brings it to the top of the matrix 
where it jumps to the 6th column to start its next downward 
movement at the point marked by "5". Algorithm 4 performs 
its staircase movement by jumping to stripe k = N — N2 = 
which completely consists of dummy rows. Hence, it skips this 
dummy rows without any data processing and continues its 
downward movement at the element marked by "d" which 
coincides with the element marked by "5". Both algorithms 
update <j(x) at this point by using a^(x) = 1, and d^ = d. 
At the next elements processed by the algorithms (marked 
by "6" and "e" respectively), both algorithms again use 
a^(x) = 1, and d^ = d to update c(x) and continue with 
their downward movement. The element marked by "6" is the 
last non wild card element in the 6th column such that both 
algorithms terminate in this column. During the downward 
movement in column 6, the only elements on the trajectory of 
Algorithm 4, which differ from the elements on the trajectory 
of Algorithm 3 are the elements of the dummy rows in the 
hatched boxes. However, for all of them n — l< N — N^ holds, 
and therefore they are skipped without any data processing 
such that Algorithm 4 terminates with the same result as 
Algorithm 3. 

We note, that Algorithm 3 and Algorithm 4 are only equiv- 
alent in the sense, that they process the same data and create 
the same results in all processing steps. However, they are not 
equivalent with respect to their computational complexity. In a 
staircase movement during the initialization phase, i.e., when 
a^ h '{x) = 0, Algorithm 3 jumps to the top of the matrix 
and processes several elements which are known to yield a 
zero discrepancy while Algorithm 4 omits this elements and 
consequently has a lower computational complexity. 

At the end of the day it turns out, that the structure of 
Algorithm 4 looks quite similar to the structure of the GIAMS 
from [2]. In fact, our algorithm can be distinguished from the 
GIAMS by two details. However, these details are non-trivial 
and crucial extensions to enable the algorithm to work properly 
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with sequences of varying length. 

The first difference is, that we initialize the auxiliary buffers 
a^ix) = instead of a^(x) = 1, h = 1, . . . , t. This allows 
us to prove that Algorithm 4 exactly mimics the processing 
steps of Algorithm 3 and therefore always solves Problem 2. In 
contrast to this, the data processing flow in the GIAMS is not 
always identical to the data processing flow in the FIA. Hence, 
the correctness of the GIAMS does not immediately follow 
from the correctness of the FIA in [2]. Moreover, initializing 
<j( h '(x) = 1 only works for sequences with equal length, at 
least in the straightforward way used by [2]. 

The second difference is the condition n — I > N — Nh- 
In the matrix way of thinking, this condition makes sure, that 
the rows are always sorted with an increasing number of wild 
cards. As discussed in Section III, this is essential for the 
varying length case to obtain the shortest possible solution in 
any case, even though the assignment of values to the wild 
cards is done in a "greedy" manner. In the sequence way of 
thinking, the condition n — l> N — N^ ensures that the shorter 
sequences are aligned to the right. The GIAMS aligns these 
sequences to the left, which can cause the optimum solution 
to be excluded from the set of possible solutions. 

At this point we also want to note, that the requirements 
in the Theorems 2 and 3 to have the sequences sorted with 
respect to their length are introduced only to keep the notation 
traceable. Algorithm 4 also works, if the input sequences 
are provided in an arbitrary order. However since a formal 
proof for this case would require to introduce a quite intricate 
notation without giving further insight into the topic, this 
formal proof is omitted here. 

VII. Conclusions 

In this paper, we considered the problem of synthesizing 
the shortest linear feedback shift-register for generating t 
sequences of varying length over some field F, which is 
formally stated by Problem 2. Notwithstanding the fact, that it 
is stated in [2] that Problem 2 can also be solved by the Feng- 
Tzeng algorithm, we demonstrated that this is generally not 
true. We identified the specific problem which arises, when the 
FIA from [2] is applied to sequences of varying length, and 
explained how this problems can be avoided by an extension of 
the algorithm (SFIA) which modifies the processing order such 
that long sequences are always processed before shorter ones. 
In this way, we always ensure a correct result, notwithstanding 
of the fact, that we still have the greedy characteristic trait of 
the original FIA. Furthermore, unlike the original FIA from 
[2], our versions of the FIA and the SFIA are also applicable 
for rank(A) = N, i.e., for sequences with maximum linear 
complexity. 

To derive an efficient Berlekamp-Massey like algorithm, 
we inserted an intermediate step, in which we derived a 
modification of the SFIA. We proved step by step, that also 
this modified algorithm (MIA) yields a correct solution to 
Problem 2, even in cases in which it behaves different from the 
SFIA. In this way, we obtain a theoretical basis for deriving 
and proving our final algorithm, since it exactly mimics the 
data processing flow of the MIA. 



The structure of the final algorithm, which we we obtained 
in this way, is quite similar to the GIAMS from [2]. However, 
it differs in crucial details from the GIAMS. Our algorithm is 
different in the order in which the sequences are processed. 
This is achieved by comparing the difference between the 
element index n and the shift-register length I to the difference 
N — Nh and skipping the sequence whenever n — I < N — Nh- 
Furthermore, our algorithm differs in the way, in which the 
auxiliary polynomials a^ h '(x) are initialized. The algorithm 
from [2] uses a^ h ' (x) = 1 to initialize this polynomials while 
we initialize a^ h '(x) = 0. This way of initialization ensures 
the equivalence to the MIA and eliminates initialization prob- 
lems for the varying length case. 

The derivation of our algorithm is performed step by step 
in a constructive way, starting from the general problem of 
finding the smallest initial set of linearly dependent columns in 
a matrix. This step by step approach provides us with a chain 
of proof, which enables us to formally prove the correctness 
of Algorithm 4. However, it may also be possible to prove 
Algorithm 4 a posteriori in a direct way, using the techniques 
from [3], [18], [19], or others. 
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